UNITED STATES OF AMERICA 



SPECIFICATION 

BE IT KNOWN that We, GEOFFREY HOWARD BLACKHAM, IAN 
MURDOCH MACPHERSON and ADAM NEALE, respectively of 58 
Adastra Avenue, Keymer, Hassocks, West Sussex, BN6 SDR, 
United Kingdom, 12 Coombes Road, Steyning, West Sussex, 
BN44 3LF, United Kingdom and 23 Shooting Field, Steyning, 
West Sussex, BN44 3RQ, United Kingdom, all citizens of the 
United Kingdom, have invented new and useful IMAGE DISPLAY 
APPARATUS of which the following is a specification. 
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IMAGE DISPLAY APPARATUS 

This invention relates to wide field of view visual 
display apparatus, for example for flight simulators. More 
especially, this invention relates to an improvement in 
displays which have a very large total field of view, a 
large field of regard, and one or more high resolutions 
areas within the total displayed field of view. 

Wide field of view displays have been provided using a 
dome of large radius with one or more projectors projecting 
images on to the inside surface of the dome. With this 
type of apparatus, the ideal projection point is co- located 
with the ideal viewing point at the centre of the dome 
surface. However, in order to achieve a practical 
solution, the viewing point and/or the projection point (s) 
are displaced from the centre, introducing geometric and 
brightness distortion to the perceived image. Furthermore, 
the use of multiple projectors requires that the projection 
points of the projectors be separated, and the overall 
. requirement is usually met by mounting the projectors away 
from the ideal location and providing geometry and 
brightness distortion at each projector to provide an 
undistorted image of apparent uniform brightness when 
viewed from the required view point . 

Hitherto, it has been expensive to fill a wide field 
of view display with imagery. The expense is incurred both 
in the provision of projectors, and in the provision of 
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image generator channels to drive multiple projectors. 
Various attempts have been made to alleviate this problems. 
These attempts have included helmet mounted area-of- 
interest displays, such as the CAE Electronics Company's 
fibre optic helmet mounted display in which a helmet 
mounted display provides an eye tracked area-of -interest 
display. The attempts have also included off -head area-of - 
interest displays such as the eye line of sight responsive 
wide angle visual apparatus described in US 4479784, in 
which a helmet mounted oculometer is used to steer a foveal 
projector to produce a high resolution insert at the 
viewer' s point of regard, with a low resolution peripheral 
view being projected via a separate, low resolution, 
projector. 

As an alternative to the use of a large dome with 
projection systems, a display for advance research and 
training was developed and is described in US 5137450. The- 
display for advanced research and training uses a number of 
pentagonal shaped flat back projection screens to form a 
partial dodecahedron surrounding the simulator pilot, .the 
back projection screens being positioned approximately 1 
metre from the design eyepoint and joined together at their 
edges with a 10mm wide dark separation band, it being 
asserted that this dark separation band does not cause 
distraction. Projectors mounted outside the dodecahedron, 
one per facet, project images on to the back projection 
screens to produce a wide angled image for the simulator 
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pilot. This use of one projector per facet produces fairly- 
low resolution imagery. 

The display for advanced research and training has 
been further developed and is described in US 5320534. 
This further development involves the addition of a helmet 
mounted high resolution area-of -interest display to be used 
in conjunction with the low resolution background image of 
the original display for advanced research and training. 

A further development of the approach utilised in the 
display for advanced research and training has been to use 
display screens close to the viewpoint . This further 
development is disclosed in US 5487665. The . development 
involves a multifaceted dome emulation with both a 
background and a target projector per facet, the projectors 
being mounted outside the projection screen. Both 
projectors cover the whole facet optically/ and the 
background projector projects a low resolution image over 
the entire facet. Targets, produced by the image 

generation system at high resolution, are each displayed as 
a mini - shrunken raster on the target projector, with each 
shrunken raster being positioned on the projector tube face 
to position the target at the correct position on the 
screen facet. Such apparatus has limitations and, for 
example, one such limitation is that the blending of images 
produced by different projectors with differing resolutions 
always produces artefacts in the display. In addition, it 
is difficult to maintain accuracy in the alignment of the 
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target projectors, and the image may jump when moving from 
one facet to another due to slight misalignments between 
the target projectors at the transition point. 

It is an aim of the present invention to provide wide 
angle display apparatus with a uniform high resolution 
capability, in which low resolution wide field of view and 
high resolution narrow field of view images are able to be 
electronically processed into a common high resolution 
pixel format and blended before being displayed by very 
high resolution display apparatus. 

Accordingly, the present invention provides image 
display apparatus which combines low and ■ high resolution 
image data in a common data format prior to display. 

The apparatus may be one in which a low resolution 
image is resampled to increase the pixel count to that of 
the highest resolution imagery. 

The apparatus may be one in which a low resolution 
image is interpolated to increase the pixel count to that 
of the highest resolution imagery. 

The composite imagery may be stored in a frame buffer. 
The frame buffer may be segmented to drive a matrix of 
display devices. 

The image display apparatus may comprise an image 
generator with multi- channel outputs, each channel of which 
may contain multiple component images with the same or 
differing resolutions, an image processing unit which 
separates the component image windows, resamples the low 
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resolution component images to a common smaller pixel size, 
assembles the component images into a high resolution frame 
store for the display, and outputs the high resolution 
images to a high resolution display system. The high 

resolution display system may be a single high resolution 
device, or may be composed of a number of lower resolution 
display devices arranged in a matrix. 

An embodiment of the invention will now be described 
solely by way of example and with reference to the 
accompanying drawings in which: 

Figure 1 shows wide angle display apparatus composed 
of a matrix of display devices; and 

Figure 2 shows a block diagram of the apparatus . 

Referring to Figure 1, there is shown a sample 
representation of wide angle display apparatus 2 having 
three display planes ABC, with each display plane having 
four fixed display devices Al, A2, A3, A4 etc, mounted in 
the form of a matrix so as to form a continuous display. 
It will be appreciated that a practical system may utilise 
a matrix containing more display devices, and that the 
matrix of the display devices is not necessarily mounted to 
form a planar array. 

Computer image generation apparatus is well known. 
The principals are described in "Principals of Interactive 
Computer Graphics", William M. Newman and Robert F. 
Sproull, 2nd Edition, 1981, McGraw Hill Book Company. 
Modern computer image generation apparatus is capable of 
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providing multiple overlapping images with different fields 
of view and resolutions for display of flat or curved 
surfaces . 

Referring to Figure 2, there is shown a block diagram 
of the apparatus 2 . As can be seen from Figure 2 , the 
apparatus 2 comprises an image generator 4 in the form of a 
multi- channel device in which each channel output may be 
composed of a single component window representing a large 
field of view at low resolution, or a narrower field of 
view at a higher resolution, or several smaller component 
windows representing relatively narrow fields of view. 

A host computer 6 provides the image generator 4 with 
eyepoint position, eyepoint orientation in terms of roll, 
pitch and yaw and the relative orientation of each 
component image so that the component images may be 
generated. 

The host computer 6 or the image generator 4 also 
provides control signals to an image processing unit 8 for 
each component image, defining location in the image 
generator output data stream, size, the required 
interpolation, and the position in the final display. 

The image generator output signals are routed to the 
image processing unit 8 which processes the component image 
signals into a single output image frame store 10 for the 
display. The output image frame store 10 has multiple 
output signals which are converted to video signals to 
drive a matrix of display devices as indicated in Figure 2 . 
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High resolution component images are extracted from 
the image generator output data streams using the control 
signals to identify the components, passed through the 
image processing unit 8, and stored in the output frame 
store 10. 

Low resolution component images are extracted from the 
image generator output data streams using the control 
signals to identify the components and control the 
processing, resampled to the same pixel size as the high 
resolution images, and stored in the output frame store 10. 
Resampling into smaller pixels can be performed by the use 
of a standard interpolation method, for example by-linear 
interpolation, to transition the data between the pixel 
values produced by the image generation apparatus 2 . Other 
interpolation equations may be used as an alternative, as 
well as adaptive methods which depend upon the complexity 
of the computed image surrounding the interpolation 
interval . It is preferred but not essential that the lower 
resolution pictures are generated with a pixel size which 
is a multiple of the smallest pixel size used in the 
apparatus 2 . 

The output frame store 10 can be implemented in a 
number of ways, and one such implementation is to use a 
multiple -plane frame store in which different component 
images are stored in different planes and a one bit plane 
is used as a mask to select when a component is used for 
output. In this way, the output data stream from the 
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output frame store 10 can be a combination of the low and 
high resolution images, and the high resolution component 
images can be positioned anywhere in the display. 

A preferred display arrangement for use in the 
apparatus is a fixed matrix of display devices arranged to 
form a continuous display. For output, the output frame 
store 10 is preferably partitioned into sections 
corresponding to the display devices in the matrix to 
reduce the band width requirements of the individual video 
channels and display devices. 

For simulation purposes, a component may be a low 
resolution background scene, or a higher resolution area of 
interest, for example a target, within the total scene. 
The image generator 4 can compute a number of components 
under the control of the host computer 6, and the image 
processing unit 8 will resample all the low resolution 
components to the required high resolution pixel interval 
and pass each component to the output frame store 10 where 
it will be combined with the other components to form a 
complete image. A component may be a target area in which 
the computed area is centred on the target, or may be an 
area of interest steered by head and/or eye movements . 

It is to be appreciated that the embodiments of the 
invention described above with reference to the 
accompanying drawings have been given by way of example 
only and that modifications may be made. 



